SERIAL NO. 09/899,843 : PROPOSAL FOR EXAMINER^S AMENDMENT 
IN THE CLAIMS : 

1. (Currently amended) A reliable symbol identification method for use in a communication 
system for transmitting symbols of a high order constellation, comprising: 

estimating decoded symbols from a sequence of captured samples representing a 
communication signal captured at a receiver, 

calculating a reliability factor of a candidate sample from values of a plurality of 
estimated symbols in proximity to an estimated symbol that corresponds to the candidate 
sample, 

if the reliability factor is less than a predetermined limit, designating the candidate 
sample as a reliable symbol. 

2. (Original) The method of claim 1, wherein the reliability factor R of the candidate 
sample Xn is given by: 

R(xn)= S dn_i Ci, where 

i=-K, ' ' 

dn_i is an estimated symbol, 

Ki, K2 are the number of decoded estimated symbols adjacent to symbol dp the 

condidQto sample , and 

q is a coefficien t representing any prior knowledge of intersymbol interference effects . 

3. (Original) The method of claim 2, wherein Ki is zero. 

4. (Original) The method of claim l,wherein the reliability of a two-dimensional candidate 
sample Xp is given by: 



R(xn)= Z Jd2 +d2 -Cj, Where 



i=-K, 



d. and d^ respectively represent values of an estimated symbol dn-i in first and 
second dimensions. 
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Ki, K2 are the number of samp l es estimated symbols adiacent to symbol d^fehe 

cand i dat e somp i c , and 

Q is a coefficient representing any prior knowledge of intersvmbol interference effects . 

5. (Original) The method of claim 1, wherein the estimating comprises: 
rescattering the captured samples according to currently known ISI effects, and 
generating estimated symbols from the rescattered samples according to decision 

regions of a governing constellation. 

6. (Original) The method of claim 1, wherein the estimating comprises generating 
estimated symbols according to a maximum likelihood analysis of conditional probabilities of a 
captured sample conditioned upon all possible sets of surrounding transmitted symbols and the 
ranges of all possible ISI coefficients, for all possible values of the captured sample. 

7. (Original) The method of claim 1, wherein the estimation comprises generating 
estimated symbols according to trellis decoding based upon all possible sets of surrounding 
transmitted symbols and the ranges of all possible ISI coefficients, for all possible values of the 
captured sample. 

8. (Original) The method of claim 1, wherein the estimating comprises generating 
estimated symbols according to a maximum likelihood analysis of conditional probabilities of a 
captured sample conditioned upon all possible sets of surrounding transmitted symbols and the 
ranges of all possible ISI coefficients, and a uniform distribution of ISI coefficients for all 
possible values of the captured sample 

9. (Original) The method of claim 1, wherein the estimation comprises generating 
estimated symbols according to a maximum likelihood analysis of conditional probabilities of a 
captured sample conditioned upon past symbol decisions and the ranges of all possible ISI 
coefficients, for all possible values of the captured sample. 

10. (Currently amended) A reliable symbol identification method for use in a communication 
system for transmitting symbols of a high order constellation, comprising: 

estimating decoded symbols from a sequence of captured samples representing a 
communication signal captured at a receiver, 
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calculating a reliability factor of a candidate sample from values of a plurality of decoded 
symbols in proximity to the candidate sample, 

if the reliability factor is less than a predetermined limit, designating the candidate 
sample as a reliable symbol. 

11. (Currently amended) The method of claim 10, wherein the reliability factor R of the 
candidate sample Xn is given by: 

R(xn)= S dn_i Ci, where 

dn_j is a decoded symbol, 

Ki, K2 are numbers of decoded symbols adjacent to symbol d^ thQ candidate somplc , 

and 

Cj is a coefficien t representing any prior knowledge of intersvmbol interference effects . 

12. (Currently amended) The method of claim 11, wherein Ki is zero. 

13. (Currently amended) The method of claim 10, wherein the reliability of a two- 
dimensional candidate sample Xn is given by: 

R(xn)= Z .Cj, where 

i;tO 

d. and d« respectively represent values of an estimated symbol dn_jin first and 
second dimensions, 

Ki, K2 are numbers of decoded symbols adjacent to symbol d^ thc cand i date samp l e , 

and 

Cj is a coefficient representino any prior knowledge of intersvmbol interference effects . 

14. (Currently amended) The method of claim 10, wherein the estimation comprises: 
rescattering the captured samples according to currently estimated ISI effects, and 
generating estimated symbols from the rescattered samples according to decision 

regions of a governing constellation. 
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15. (Currently anriended) The method of claim 10, wherein the estimating comprises 
generating estimated symbols according to a maximum likelihood analysis of conditional 
probabilities of a captured sample conditioned upon all possible sets of surrounding transmitted 
symbols and the ranges of all possible ISI coefficients, for all possible values of the captured 
sample. 

16. (Currently amended) The method of claim 10, wherein the estimating comprises 
generating estimated symbols according to trellis decoding based upon all possible sets of 
surrounding transmitted symbols and the ranges of all possible ISI coefficients, for all possible 
values of the captured sample. 

17. (Currently amended) The method of claim 10, wherein the estimating comprises 
generating estimated symbols according to a maximum likelihood analysis of conditional 
probabilities of a captured sample conditioned upon all possible sets of surrounding transmitted 
symbols and the ranges of all possible ISI coefficients, and a uniform distribution of ISI 
coefficients for all possible values of the captured sample 

18. (Currently amended) The method of claim 10, wherein the estimating comprises 
generating estimated symbols according to a maximum likelihood analysis of conditional 
probabilities of a captured sample conditioned upon past symbol decisions and the ranges of all 
possible ISI coefficients, for all possible values of the captured sample. 

19. (Currently amended) An equalization method for use in a communication system for 
transmitting symbols of a high order constellation, comprising: 

estimating decoded symbols from captured samples based on a set of ISI coefficient 
estimates, the captured samples representing a communication signal captured at a receiver, 
and 

revising the ISI coefficients based on the decoded symbols and corresponding received 
sample values, wherein the contribution of each symbol-sample pair is weighted according to 
reliability factor of the respective captured sample. 

20. (Original) The equalization method of claim 19, wherein the weighting of a symbol- 
sample pair comprises: 

comparing the reliability factor of a candidate sample to a threshold, and 



598148_1.DOC 



Page 4 of 14 



12805/46001 



Applicant: Eilon RIESS 
Serial No. 09/899,843 

assigning a first weight value to the symbol-sample pair if the reliability factor e xc ee ds is 
less than or equal to the threshold, and 

otherwise, assigning a second weight value to the symbol-sample pair. 

21. (Original) The equalization method of claim 19, wherein the weighting of a symbol- 
sample pair is inversely proportional to the reliability factor of the candidate sample. 

22. (Currently amended) The equalization method of claim 19, wherein the weighting of a 
candidate sample comprises: 

comparing the reliability factor of the candidate sample to a threshold, and 

assigning a first weight value to the symbol-sample pair if the reliability factor exceeds is 

less than or equal to the threshold, and 

otherwise, assigning a second weight value to the symbol-sample pair, the second 

weight being inversely proportional to the reliability factor of the candidate sample. 

23. (Canceled). 

24. (Original) The equalization method of claim 19, wherein the reliability factor of a 
candidate sample Xn is determined from values of neighboring samples. 

25. (Original) The equalization method of claim 24, wherein the reliability factor R of a 
candidate sample Xn is given by: 

K, 

R(xn)= I|xn-i| ci, Where 

i^O 

Xn-i is a value of a surrounding sample, 

Ki, K2 represent numbers of samples adjacent to sample Xn, and 

Q is a coefficien t representing any prior knowledge of intersvmbol interference effects . 

26. (Original) The equalization method of claim 24, wherein the reliability factor R of a 
candidate sample Xn is given by: 

R(Xn)=S|xn-i|ci, where 

i=1 

Xn-i is a value of a surrounding sample, 

K represents a number of samples neighboring to sample Xn, and 

q is a coefficien t representing anv prior knowledge of intersymbol interference effects . 
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27. (Original) The equalization method of claim 24, wherein the reliability factor R of a 
candidate sample Xn is given by: 

R(xn)= S jx^ -Ci, where 

i^O 

X, and x„ respectively represent values of a captured sample Xn-i in first and second 
dimensions, 

Ki, K2 represent numbers of samples neighboring to sample Xn, and 

Cj is a coefficien t representing any prior knowledge of intersvmbol interference effects . 

28. (Original) The method of claim 27 where = 0 . 

29. (Original) The equalization method of claim 19, wherein the reliability factor of a 
candidate sample Xn is determined from values of estimated symbols dn_j neighboring the 
candidate sample. 

30. (Original) The equalization method of claim 29, wherein the reliability factor R of a 
candidate sample Xn is given by: 

R(xn)= Z dn-i -Cj, where 

i=-Kj ' 

dn_i is a value of an estimated symbol, 

Ki, K2 represent numbers of estimated symbols samp l es neighboring to symbol 
dp samp l e X f,, and 

q is a coefficien t representing any prior knowledge of intersymbol interference effects . 

31. (Original) The equalization method of claim 29, wherein the reliability factor R of a 
candidate sample Xn is given by: 

R(Xn) = S|dn-i| ci, where 
dn_j is a value of an estimated symbol, 

K represents a number of estimated symbols samp l es neighboring to symbol dnSampte 

Xn, and 

Q is a coefficien t representing anv prior knowledge of intersymbol interference effects . 
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32. (Original) The equalization nnethod of claim 29, wherein the reliability factor R of a 
candidate sample Xn is given by: 

R(xn) = Z Jd^ +d2 . Cj , where 

i=-K/ 
i;tO 

d. and d« respectively represent values of an estimated symbol dn_i in first and 
second dimensions, 

Ki, K2 represent numbers o f samp l es estimated symbols neighboring to symbol 
dn s amp l e x ^, and 

Cj is a coefficient representing any prior knowledge of intersvmbol interference effects . 

33. (Original) The method of claim 32 where K-i = 0. 

34. (Original) The equalization method of claim 19, wherein the estimating comprises: 
rescattering the captured samples according to the set of ISI coefficient estimates, 
estimating symbols from the rescattered samples according to decision regions of a 

governing constellation. 

35. (Original) The equalization method of claim 34,wherein the reliability factor R of a 
candidate sample Xn is given by: 

K2 

R(xn)= Z|yn-i| ci, Where 

i=-K, 

yn-i is a value of a rescattered sample, 

Ki, K2 represent numbers of rescattered samples neighboring to rescattered sample xyn, 

and 

Q is a coefficien t representing anv prior knowledge of intersvmbol interference effects . 

36. (Original) The equalization method of claim 34, wherein the reliability factor R of a 
candidate sample Xn is given by: 

R(xn) = i:|yn-i| ci, where 

i=1 

yn-i is a value of a rescattered sample, 

K represents a number of rescattered samples neighboring to rescattered sample 
yn somp i c X e, and 
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Cj is a coefficien t representing any prior knowledge of intersvmbol interference effects . 

37. (Original) The equalization method of claim 34, wherein the reliability factor R of a 
candidate sample Xn is given by: 

R(xn)= Z jy? . Cj, where 

i=-K, ^ 

y. and y, respectively represent values of a rescattered sample yn_i in first and 
second dimensions, 

Ki, K2 represent numbers of rescattered samples neighboring to rescattered sample 
yn sampic X r, and 

Cj is a coefficien t representing any prior knowledge of intersvmbol interference effects . 

38. (Currently amended) The equalization method of claim 19, wherein the estimation 
comprises generating decoded symbols according to a computational approximation of: 

( V 

i=-Ki 

Pr(xn|h^)= Z l-r^^ ^ Pr(a)Pr^;;;;j;}ja, where 

represents a k* estimate of the captured sample Xn, 
k is an index running from a first value -Ki to a second value K2, 

Dn+iJ; ={hn^K/"•^+1'^-1••••^-K,>' 

represents a variance in channel noise, and 
Pr(a) is a probability density function of the ISI coefficients a\, 

39. (Original) The equalization method of claim 19, wherein the estimating and the revising 
operate on captured samples and estimated symbols on a frame-by-frame basis. 

40. (Original) The equalization method of claim 39, wherein the frames each contain a 
uniform number of captured samples and estimated symbols. 

41. (Original) The equalization method of claim 39, further comprising: 

designating captured samples as reliable symbols based on the captured samples' 
reliability factors, and 
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assembling a frame to include a set of captured samples and a set of reliable symbols 
from a preceding frame. 

42. (Original) The equalization method of claim 39, further comprising: 

designating captured samples as reliable symbols based on the captured samples' 
reliability factors, and 

assembling a frame to include a set of captured samples and a set of reliable symbols 
from multiple preceding frames. 

43. (Original) The equalization method of claim 39, wherein frame lengths vary according 
to a regular progression of predetermined lengths. 

44. (Original) An equalizer for use in a communication system for transmittino symbols of a 
high order constellation, comprising: 

a symbol decoder having a first input for captured samples, a second input for estimated 
ISI coefficients and an output for estimated symbols, 

an ISI estimator having a first input coupled to the symbol decoder output, a second 
input coupled to the first input of the symbol decoder and an output for the estimated ISI 
coefficients, wherein the ISI estimator estimates ISI coefficients based on the decoded symbols 
and corresponding received sample values, each symbol-sample pair being weighted according 
to reliability factor of the respective captured sample. 

45. (Original) The equalizer of claim 44, wherein the symbol decoder comprises a 
subtractive equalizer coupled to a decision unit. 

46. (Original) The equalizer of claim 44, wherein the symbol decoder comprises a maximum 
likelihood estimator coupled to a decision unit. 

47. (Original) The equalizer of claim 45, wherein the maximum likelihood analysis is made 
having assigned a uniform probability distribution for ISI coefficients over their ranges. 

48. (Original) The equalizer of claim 46, wherein the maximum likelihood analysis is made 
having assigned previously decoded symbols to occur with probability equal to one. 

49. (Original) The equalizer of claim 44, wherein the symbol decoder comprises a trellis 
decoder coupled to a decision unit. 
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50. (Currently amended) The equalizer of claim 44, wherein the symbol decoder generates 
decoded symbols according to a computational approximation of: 



represents a variance in channel noise, and 
Pr(§) is a probability density function of the ISI coefficients ai. 

51. (Original) The equalizer of claim 44, further comprising a reliable symbol detector 
having an input coupled to the first input of the symbol decoder and an output that enables the 
symbol decoder. 

52. (Currently amended) A receiver for use in a communication svstem for transmitting 
symbols of a hioh order constellation, comprising: 

a demodulator to generate captured samples from a communication signal received via 
a channel, 

a memory system coupled to the demodulator, the memory system logically organized 
as a captured sample buffer and a decoded symbol buffer, and 

a processor coupled to the memory by a communication path, the processor logically 
organized as a reliable symbol detector, an ISI estimator and a symbol decoder, the reliable 
symbol detector to identify which of the captured samples are likely to be located within a 
correct decision region of a constellation notwithstanding ISI effects of the channel, the ISI 
estimator to estimate the ISI effects based on the symbols so identified by the reliable symbol 
detector , and the symbol decoder to generate decoded symbols from the captured samples in 
response to the estimated ISI effects . 

53. (Original) The receiver of claim 52, wherein the symbol decoder is embodied as a 
subtractive equalizer coupled to a decision unit. 




where, 



hj^ represents a k"" estimate of the captured sample Xn, 

k is an index running from a first value -Ki to a second value K2, 
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54. (Original) The receiver of claim 52, wherein the symbol decoder is embodied as a 
maximum likelihood estimator. 

55. (Original) The receiver of claim 54, wherein the maximum likelihood estimator assigns a 
uniform probability distribution for ISI coefficients over their ranges. 

56. (Original) The receiver of claim 54, wherein the maximum likelihood estimator assigns 
to occurrence of previously decoded symbols a probability of occurrence equal to one. 

57. (Original) The receiver of claim 52, wherein the symbol decoder is embodied as a trellis 
decoder. 

58. (Currently amended) The receiver of claim 52, wherein the symbol decoder generates 
decoded symbols according to a computational approximation of: 



represents a variance in channel noise, and 
Pr(a) is a probability density function of the ISI coefficients aj. 

59. (Original) A computer readable medium having instructions stored thereon that, when 
executed by processing unit, causes tho follow i ng a symbol estimation method to be executed 
in a communication system for transmitting symbols of a hich order constellation : 

estimating decoded symbols from a sequence of captured samples and a set of 
estimated ISI coefficients, and 

revising the estimated ISI coefficients based on the decoded symbols and corresponding 
received sample values, wherein a contribution of each symbol-sample pair to the revision is 
weighted according to reliability factors of the respective captured sample. 

60. (Original) The medium of claim 59, wherein the weighting of a symbol-sample pair 
comprises: 



hj^ represents a k^ estimate of the captured sample Xn, 

k is an index running from a first value -Ki to a second value K2, 




CK:=^.K/•••^.1'^-1•••'^-K,}' 
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comparing the reliability factor of a candidate sannple to a threshold, and 
assigning a first weight value to the symbol-sample pair if the reliability factor e x cee d s js 
less than or equal to t he threshold, and 

otherwise, assigning a second weight value to the symbol-sample pair. 

61. (Original) The medium of claim 59, wherein the weighting of a symbol-sample pair is 
inversely proportional to the reliability factor of the candidate sample. 

62. (Original) The medium of claim 59, wherein the weighting of a candidate sample 
comprises: 

comparing the reliability factor of the candidate sample to a threshold, and 

assigning a first weight value to the symbol-sample pair if the reliability factor exceeds is 

less than or equal to the threshold, and 

otherwise, assigning a second weight value to the symbol-sample pair, the second 

weight being is Inversely proportional to the reliability factor of the candidate sample. 

63. (Original) The medium of claim 59, wherein the reliability factor of a candidate sample 
is determined from values of samples neighboring the candidate sample. 

64. (Original) The medium of claim 59,wherein the reliability factor of a candidate sample 
Xn is determined from values of estimated symbols d^-i neighboring the n^ estimated symbol. 

65. (Original) The medium of claim 59, wherein the estimating comprises: 
rescattering the captured samples according to the set of ISI coefficients, 

estimating symbols from the rescattered samples according to decision regions of a 
governing constellation. 

66. (Original) The medium of claim 59, wherein the estimating comprises: 
rescattering the captured samples according to currently known ISI effects, and 
generating estimated symbols from the captured samples according to decision regions 

of a governing constellation. 

67. (Currently amended) The medium of claim 59, wherein the estimating comprises 
generating decoded symbols according to a computational approximation of: 
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( K Y 

i=-Ki 

Pr(xjh|;)= Z |-F=e ^ PryPrfe|;;}ja, Where 

represents a estimate of the captured sample Xn, 
k is an index running from a first value -Ki to a second value K2; 

represents a variance in channel noise, and 
Pr(a) is a probability density function of the ISI coefficients aj. 

58. (Original) The medium of claim 59, wherein the estimating and the revising operate on 
frames of captured samples and estimated symbols on a frame-by-frame basis. 

69-72. (Canceled). 

73. (Original) A framing method for use in a communication system for transmitting 
symbols of a high order constellation for commun i cQtion process i ng gystom , comprising: 

identifying reliable symbols from a first frame of captured samples, 
following processing of the first frame, generating a second frame of captured samples, 
the second frame comprising the reliable samples from the first frame and a second set of 
captured samples , wherein the identifyino comprises: 

estimating decoded symbols from a seouence of captured samples representing 
a communication signal captured at a receiver, 

calculating a reliability factor of a candidate sample from values of a plurality of 
estimated symbols in proximity to an estimated symbol that corresponds to the 
candidate sample, 

if the reliability factor is less than a predetermined limit, designating the 
candidate sample as a reliable symbol . 

74. (Original) The framing method of claim 73, further comprising: 
identifying reliable symbols from the second frame of captured samples, and 
assembling a third frame from a third set of captured samples and the reliable symbols 

from the second frame. 
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